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(54) Adaptable menu-controlled man-machine interface. 



(57) In an electronic device, sucli as a mobile station 
equipped with a small display (41), a certain menu of 
the most used functions is used to control the device. In 
this menu, either the user collects the most often used 
functions (B-, - 3^) or the device selects the functions 
automatically (A-i - A|sj), depending on which functk>n8 



the user uses most often. This menu is located high in 
the hierarchy of menus, so that opening the menu and 
selecting the functions included in It can be done quickly 
and easily. The functions can contain links to the func- 
tions which according to the frequency array (45e) are 
most often used after a certain f unctk>n. 
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Description 

The invention relates to the interface between a us- 
er and an electronic device, the so called nnan-niachine 
interface In general, and to adapting a menu-based in- 
terface to the personal requirements of the user in par- 
ticular The most advantageous application of the inven- 
tion is in mobile phones with a display, but it can also be 
used In other electronic devices. 

Many modern electronic devices are designed as 
menu-controlled. In the following, a digital mobile station 
with a display is described by way of example, but with 
certain generalizations, the description also pertains to 
many other Icinds of devices. Because the display of the 
mobile station is small, it can only display a very small 
menu with a limited number of options at a time. In order 
to implement a wide range of control possibilities, the 
menus are divided into several fevels. forming a hierar- 
chical tree structure. On the upper level, the user selects 
a certain group of functions, whereby a number of lower 
level operations belonging to the selected group is 
shown on the display. The most common way of ex- 
pressing the selection is to use certain control and func- 
tion keys. In this patent application, the entity formed by 
the display, menus and keys is called the Man Machine 
Interface (MMI). 

A typical MMI of a mobile station and the tree struc- 
ture of its menus is known, for example, from the oper- 
ation manual of the Nokia 211 0 mobile station published 
by Nokia Mobile Phones. The user can perform a large 
number of different selections controlling the operation 
of the mobile station by using three or four control keys. 
However, the large number of consecutive keystrokes 
needed is often a problem. As an example, we can im- 
agine a situation in which the user wants to change the 
alarm sound from an ordinary alarm to a mere beep. The 
user presses the Menu key and then selects the option 
corresponding to the alarm sound by arrow keys. With 
a certain Start key. the user can display the various pos- 
sibilities for the alarm sound, from which he selects the 
desired alternative by pressing the arrow keys. To con- 
firm the selection, the OK and Exit keystrokes are still 
needed. Seven keystrokes, including all the four control 
keys, are needed to complete the entire procedure. Be- 
cause of meetings or other occasions where a different 
telephone behaviour is required, the user may have to 
change the alarm sound several times during the day. 
in which case he may find the long series of keystrokes 
frustrating. 

A few prior art solutions to the problem described 
above are known. For example, the user of the Nokia 
2110 mobile station can memorize the numbers of the 
most frequently used menus and functions, whereby he 
can get the desired function on the display by pressing 
the Menu key and selecting the correct number with the 
numeric keys of the mobile station. However, this solu- 
tion requires menorizing numbers with as much as five 
digits, which is not suitable for ail users. The Motorola 



Micro T.A.C 8400 has a corresponding system, in which 
the numbers of the nine functions regarded as the most 
common have only one digit, whereby the user selects 
the desired function by pressing a certain arrow key and 

s one numeric key 1 -9. Motorola's solution does not help 
a user who often needs a functton which was not regard- 
ed as common by the manufacturer, who has therefore 
not added it to the quick selections. Besides, even mem- 
orizing one-digh numbers correctly is difficult for many 

10 users. 

The patent application GB-2 293 951 discloses a 
mobile station and a menu system for using it, consisting 
of branches equipped with titles, subtitles, sub-subtitles 
and selections. The user can either browse a short 
15 menu, which contains only some of the titles, or a tong 
menu, which contains all the titles. By using certain se- 
ries of keystrokes, the user can also move titles from the 
short menu to the long menu or vice versa. In this solu- 
tion, the user must be able to use complicated key com- 

^0 mands of the mobile station. 

The patent specification FI-89652 and a corre- 
sponding United States patent US-5 267 30S describe 
a telephone memo, in which the mobile station sorts the 
telephone numbers in an order according to the frequen- 
ts cy of use. However, in order to start using the telephone 
memo, the user must use menu commands as usually, 
and so this solution does not make the problem of the 
present menu-based MMI any easier. Some methods 
for adapting menu-based interfaces to the user's re- 

30 quirements are known from software intended for per- 
sonal computers. In many programs of the Microsoft 
company, a certain menu includes a list of recently ac- 
cessed files, whereby the user can open the file by se- 
lecting its name from the menu. However, the frequently 

35 used function or file is not always the same as the one 
that was used last; if the user handles dozens of files a 
day. only a few of which are needed often, their names 
may be dropped from the list when the user accesses 
other files. It is also a known technique that the user can 

40 renxsye commands he regards as unnecessary from the 
program menus and add new commands based on self- 
made macros. However, the large display of a personal 
computer allows using large menus with many different 
alternatives, and thus the known solutions cannot as 

45 such be applied to devices such as mobile stations, 
which have a small display with a modest resolution. 
Even if the user of a mobile station can add the desired 
commands to a certain menu of the prior art kind, he 
would nevertheless either have to browse the menu with 

50 the function keys to find the desired option or remember 
the number of the option added, whereby no real advan- 
tage compared to the prior art would be achieved. 

The object of this invention is to present a method 
by which the user can select the desired options by 

55 means of a menu-based MMI quickly and easily. It is 
also an object of the invention to present a method by 
which the quk:k use of a menu-based interface can be 

(*) Registered trademartc of the Motorola Company 



BNSOOCIO: <EP 0891 066 A2 I > 



8NS oaae 2 



3 



EP 0 891 066 A2 



4 



modified to correspond to the different needs of the us- 
ers. In addition, it is an object of the invention to present 
an electronic device, in which the control nrtethod ac- 
cording to the invention Is used. 

The objects of the invention are achieved by adding 
to the menu-based MM! a special menu of the often 
needed functions and by selecting the options of this 
menu according to the user's needs. 

The method according to the invention is character- 
ized In that as a response to the user's operation, certain 
options intended to be the most easily selected are col- 
lected to a certain menu. 

The Invention also relates to a man-machine Inter- 
face for controlling the electronic device. The interface 
according to the invention is characterized in that it com- 
prises a certain menu for showing the options which the 
user wants to be the most easily selected, whereby the 
options contained In the menu are determined on the 
basis of the user's operation. 

According to the Invention, a new menu branch Is 
added on a suitable level of the branched, tree-like 
menu structure, preferably on the upmost level, for the 
most frequently used functions. Most advantageously, 
the new menu is located high up in the hierarchical menu 
structure, so that opening or displaying it does not re- 
quire many keystrokes. Alternatively, it is possible to 
specify a certain simple key command, by which the us- 
er can always display the menu of the most frequently 
used functions regardless of the level on which the 
menu is kx:ated and which other part of the menu struc- 
ture is displayed at the beginning. In the following, the 
menu of the frequently used functions is called the MUM 
(Most Used Menu) for shortness. 

In order that the MUM would be useful for the user 
in all situations, the user must be able to influence the 
contents of the menu. A MUM according to the invention 
can either be updated automatically, whereby the mo- 
bile station or other devk:e in question itself records the 
frequency of various operations and produces the se- 
lections corresponding to the most often used functions 
to the menu according to the invention, or the user can 
determine the contents of the menu by using key com- 
mands. Various compromises can also be formed of 
these two alternatives, whereby the user, for example, 
selects the functions contained in the menu, but the de- 
vice arranges the menu so that the most often used 
functk>n is always the first in the menu. The MMI can 
also include a function in which the user selects which 
procedure he wants to use for maintaining a MUM menu 
according to the invention. 

In the embodiment of the invention in which the user 
selects the functions to be included in the menu accord- 
ing to the invention by key commands, the functions se- 
lected need not be the most often needed functions. The 
user can also place a rarely needed f unctk>n In the MUM 
for it to be available as easily as possible when quick 
action is required. 

In the following, the Invention will be described in 



more detail with reference to the exemplary emtxxii- 
ments and the appended drawings, in which 

Figure 1 a shows the proceeding of an embodiment 
s of the method according to the invention 

as a state diagram. 

Figure 1b shows the maintenance of the MUM in 
the case of Figure la. . 
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Figure 2a shows the maintenance of the MUM in 
another case. 

Figure 2b shows the proceeding of a second em- 
bodiment of the method according to the 
Invention as a state diagram, 

Figure 3 shows the proceeding of a third embod- 
iment of the method according to the in- 
ventbn as a state diagram, and 

Figure 4 shows a block diagram of a mobile sta- 
tion according to the inventk)n. 



2S In the figures, the same reference numbers are 
used for corresponding parts. 

Figure la shows a state diagram, In which rectan- 
gles are used to depict the states of the controlled elec- 
tronic device and circles to depict the key commands by 

30 which the state is changed. With regard to the invention, 
it does not matter In which state the user starts using 
the Most Used Menu. The text "basic state' used to de- 
scribe state 1 in the figure means this starting state. At 
point 2, the user gives ia certain key command K1 . such 

3S as a long press of the Menu key. By this command, the 
device is switched to the MUM state 3, in which it shows 
the user the alternatives in the Most Used Menu, lb ad- 
vantage, the display of the device has a cursor or other 
pointer to indk:ate which of the menu alternatives has 

40 been selected. In state 3, the cursor indicates the first 
function of the MUM, which is here called function A^, 
and which the user can perform by pressing the OK key 
at point 4. The other functions of the menu fnom A2 to 
AN require moving the cursor at the desired function by 

4S pressing the up and down arrow keys 5, 6 before press- 
ing the OK key. Using the menu by the arrow and OK 
keys is a technque known as such. The invention does 
not limit the nunriber of functions in the Most Used Menu. 
Figure 1 b shows the formation and maintenance of 

so the Most Used Menu in the case that the device which 
is the object of the invention performs the procedures 
relating to the formation and maintenance automatk:ally. 
Forming a user-specific menu for use according to the 
invention requires that a certain capacity is reserved for 

ss this in the memory of the device. In an embodiment in 
which the device updates the Most Used Menu automat- 
ically, the menrxsry of the device must also contain an 
array which describes the frequency of the functk>ns 
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performed through the menus. Always when the user 
selects a certain function from a menu, as in block 10, 
the device adds an entry to the frequency array at the 
function as in block 11 and updates the Most Used 
Menu, or fills it with the most used functions in the array, s 
as in block 12. In this emiDOdiment, the device only 
records the lowest level functions of the menus and not 
the menus or submenus, because otherwise the upper 
Jevel menus would be automatically the most often 
used; they are used frequently when the user moves io 
through them to the lower menu levels. The functions 
from Ai to AN are here ordered according to the fre- 
quency of use. 

For saving calculation capacity, filling the Most 
Used Menu, the operation of block 1 2, can be condition- is 
ai so that it takes place only when as a result of an entry 
made in the frequency an^ay, the observed frequency of 
use of a function in the array becomes higher than a 
certain threshold value, for-instance three times a day. 
Operation according to bkx;k 1 2 can also take p lace at 20 
a specified time, whereby the device can update the 
Most Used Menu once in an hour, tor example. 

In an embodiment, in which the user determines the 
contents of the MUM nDanually, adding a certain opera- 
tion to the array takes place according to Figure 2a. for 2S 
instance. The user retrieves the text indicating the de- 
sired function according to block 20, in a well known 
manner. After this, the user gives a certain key com- 
mand according to block 21 , such as a long press of the 
OK key. The device can add the function to the MUM 30 
directly or ask the user to confirm this by pressing the 
OK key again, as in block 22. After the confirm com- 
mand, the devk:e adds the function to the MUM. as in 
block 23. In an embodiment based on manual mainte- 
nance, the function to be added to the MUM can be a 3S 
function of the lowest level of the menus or a certain 
menu or submenu. The order of the functions - B,^ is 
determined by which function the user wants to be the 
most easily accessible {with the fewest keystrokes) (B,). 
whk:h the next easily accessible (B2) and so forth. From 4o 
Figure 2b it can easily be seen how many keystrokes 
are required by each function. 

One simple way by which the user can determine a 
certain place for a desired function in a manually main- 
tained Most Used Menu, is using the numeric keys in- 
stead of or in addition to the OK key when the user ac- 
cepts the desired function to the Most Used Menu. It can 
be assumed, for instance, that the user wants a certain 
functkMi to appear as the second in the MUM (function 
82 in Figure 2b). When the user selects this functton ac- so 
cording to Figure 2a. he gives a long press of the OK 
key at block 21 and presses the numeric key 2 at block 
22. It is also possible to present a combined embodi- 
ment, in which the user selects which functions should 
be included In the MUM. but the terminal device deter- ss 
mines the mutual order of the functions automatically so 
that the most frequently used of the functions selected 
by the user is the first in the MUM. the next frequently 



used is the second and so forth. 

In the preferred embodiment of the invention, re- 
moving functions from the MUM is done in the same way 
as adding functions, as shown in Figure 2a. The user 
retrieves the MUM to the display, moves the cursor at 
the function which he wants to remove, and gives a tong 
press of the OK key. The device can remove the function 
from the MUM directly or at first ask the user to press 
the OK key again for confirmation. If the Most Used 
Menu is full, but the user tries to add one more function 
to It. the device can either notify that the menu is full and 
ask the user to remove a function, or It can automatically 
remove the last or least used function from the menu. 

Figure 3 shows a combination of the embodiments 
described above. The functions from A, to AN are func- 
tions of the MUM. which the device has included in the 
MUM according to their frequency of use, like in the case 
of Figures la and lb above. The functions from B^ to 
-Bn have been added to the MUM manually by the user 
in the same way as in the case of Figures 2a and 2b. 
When the user has reached the MUM state 3, he can 
start function Ai by pressing the OK key or browse the 
list of A functions or B functions by pressing the arrow 
keys 5 and 6. Like in Figures la and 2b, the functions off 
the MUM form a loop-like list, whfch means that after 
pressing a certain arrow key consecutively as many 
times as there are functions in the MUM. the user is at 
the same point in the menu as before the keystrokes on 
the arrow key. There is no advantage in keeping a cer- 
tain function in the MUM in more than one place. If. for 
instance, the user has selected function 84 in the MUM 
and uses it so often that the device includes it in the A 
functions, such as function Ag. it is advantageous to skip 
this function In the B group, whereby one press of the 
arrow key moves the cursor in the MUM directly from B3 
to B5 or vice versa. It is also possible to present an em- 
bodiment as in Figure 3, in which the device does not 
include In the A functbns any of the functions selected 
by the user manually in the MUM as a B functbn. 

The functions of the Most Used Menu can also con- 
tain links to other functions, particularly in an embodi- 
ment in which the device automatically measures the 
frequency of occurrence of various functions. It is name- 
ly typical of certain situations that the user must make 
many consecutive changes of operation. For example, 
a mobile phone user who is leaving a meeting often 
wants to switch the sound alarm and key sounds on and 
the call transfer off. The most often used of these func- 
tions is switching the sound alamn, and thus it is likely 
to be Included in the MUM with the highest priority. When 
the user accepts the switching on of the sound alarm by 
pressing the OK key. the mobile station detects that In 
a certain frequency array modelling the sequence of 
functions, the switching of the sound alarm is often fol- 
lowed by the switching of the key sounds. Thus the de- 
vice automatfcally moves the cursor in the display to in- 
dicate the switching of the key sounds, whereby the user 
only needs to press the OK key again to select this func- 
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tion or press ignore, if he does not want to switch the 
key sounds on. 

In order to form a frequency an-ay for nnodeNing the 
linked function groups or the sequence of functions, the 
device continuously follows the functions selected by s 
the user and saves information on which operations the 
user selects consecutively within a certain short period 
of time, for instance during one minute. It is then not 
expected that the user would select certain functions al- 
ways in the same order. For example, the consecutive io 
switching off of the key sounds and sound alarm and the 
activation of the call transfer In this order are statistically, 
as a function group, the same as the switching off of the 
sound alarm followed by the switching off of the key 
sounds and the activation of the call transfer in this or- is 
der, within the specified period. 

It is common that the user frequently needs func- 
tions of the ON-OFF type in his devtee. such as switch- 
ing the call transfer on and off. Because the switching 
on is always at some next stage folbwed by switching 
off and vice versa, the user uses both of these functions 
equally often. Thus the Most Used Menu should have 
two alternatives with the same frequency: switching on 
and off. However, this is not practical, because when the 
call transfer is switched on, the only possible function is 2S 
switching it off and vice versa. Therefore it is recom- 
mended to arrange the MUM according to the invention 
practically so that the device examines which of the ON- 
OFF statees is in use and shows in the Most Used Menu 
only the altemative for changing the state. There can 30 
also be more than two mutually exclusive alternatives, 
that is. there may be the alternatives A, B, C and D avail- 
able for a function, and only one of them, a function or 
a group of functions, is possible at a time. 

Figure 4 shows a simplified block diagram of a mo- 3S 
bile station. The microphone 40, the transmission block 
46, the duplexing block 47, the reception block 43 and 
the speaker 49 can be of the prior art kind, as well as 
the display 41 , in which the nnobile statk^n shows the 
user the function menus, among other things, and the 40 
keypad 42, by which the user gives the mobile station 
key commands. The control block 44 is preferably a well 
known microprocessor, which controls the operation of 
the mobile station by executing a program saved in the 
memory 45. The memory 45 can be an integral part of 
the mobile station, or it can be partly located in a sepa- 
rate storage medium, such as a SIM card (Subscriber 
Identity Module). The lower part of the Figure shows the 
contents of the memory 45 In more detail. The block 46a 
contains the names and/or other identification codes of 50 
the functkxis which form the Most Used Menu at a time. 
The bkx:k 45b is an array, which contains the values de- 
scribing the frequency of use of each function. On the 
basis of the values contained in block 45b. the mobile 
station can maintain the MUM automatically- The block 55 
45c. contains Information of mutually exclusive func- 
tions, of whk:h it is practk:al to have only one or a certain 
smaller group at a time in the Most Used Menu. Using 



the block 45 takes place so that always before showing 
the Most Used Menu or a part of in the display, the mo- 
bile station checks the functions of the MUM one by one 
by comparing them to the contents of the block 45c. If it 
appears for a f unctk>n that in the present situation it is 
not possible or practical to show it In the MUM, it is left 
out of it for the time being. 

Block 45d contains the whole menu structure, that 
is, all the functioris of all the menus and information of 
their mutual relations (which functions bebng to which 
menu etc.). This is the necessary basis that enables 
showing menus to users. Block 45e contains the links 
between consecutive operations, or in other words, in- 
formation of the groups or chains of operations whfch 
the user often uses in connection with one another. The 
block 45e can be arranged in two parts (not shown in 
the figure) so that the first part only comprises those 
function groups whk:h include functions used at least 
three times in connection with one another during the 
last two weeksr for example; these are mutually linked 
functions, whereby as a result of performing one of 
them, the mobile station immediately offers the user the 
next function of the same group. The second part can 
comprise those function groups which include functions 
used once or twice in connection with one another dur- 
ing the last two weeks; these groups are "candidates" 
for the first part, and they are moved to it If the detected 
frequency of use of the functions In connection with one 
another grows high enough. The block 45f contains, in 
a known manner, a program code by which the control 
block 44 controls the operation of the nnobile statk)n. 
Naturally, the memory 45 can also contain a k>t of other 
informatk>n. 

Many modem, portable communication devices 
provide various program applications which are not re- 
lated to the actual use of the mobile station in the same 
way as the properties mentioned above, such as setting 
the sound alarm and the key sounds and using the call 
transfer. Examples of such appllcatk)ns include an in- 
ternet connection, teleshopping. telebanking, calendar 
and games. The Invention can also be applied In con- 
nectk^n with the program applications, ei^er so that 
commands relating to the applications are in the same 
Most Used Menu as the menu options relating to the 
normal use of the mobile station, or so that there are 
separate Most Used Menus for the program applicatk>ns 
and the normal use properties. Combining into the same 
menu can take place directly, whereby all the functions 
and application commands are in the menu In an abso- 
lute order by the frequency of use or in an user-specified 
order, or. for example, ordered by the principle shown 
in Figure 2b, whereby pressing an "up* arrow key from 
the "topmost" function of the MUM (function in Figure 
2b) is browsing towards the program applications, and 
pressing a "down' arrow key is browsing towards the 
functions related to the normal use properties. 

The invention provides an advantage as compared 
to the prk>r art, because the number of keystrokes or 
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other commands required by the most frequent func- 
tions in controlling the electronic device is reduced. In 
addition, the degree of necessity and generality of the 
f unctbns can be personally decided by each user. It is 
cleartoapersonskilledintheartthatthekeycommands s 
named above, such as pressing the Menu and OK keys, 
are used by way of example and do not limit the inven> 
tlon. Many different methods of giving commands are 
known in the technology of devices controlled by key 
commands, which methods can be applied in the case 10 
of the preserit invention. In addition, there are voice-con- 
trolled electronic devices, to which the invention can al- 
so be applied, whereby the opening of the Most Used 
Menu is performed by a certain speech command, and 
moving the cursor in the menu and selecting a certain is 
option are performed by other speech commands. 

. ..Clalma 

20 

1. A man-machine interface for controlling an elec- 
tronic device, which interface comprises menus for 
showing alternative functions to the user, charac- 
terized in that it comprises a certain menu for show- 
ing the options (A-, - A^. - - B^) which shoud be 2S 
the most easily selected, whereby the options con- 
tained in said menu are determined on the basis of 

the user's operation. 

2. A method for implementing the interaction between 30 
the electronk: device and its user in an electronic 
device. In which method options are shown in the 
form of menus, characterized in that as a response 

to the user's operatk>n, certain options intended to 

be the most easily selected (A, - A,^, B^ - Bf^) are ^ 

collected to a certain menu. 



mand given by the user, which command corre- 
sponds to selecting a certain first option from said 
menu, the next option shown by the device Is the 
one whk:h on the basis of previous use Is the most 
likely to foltow said first optbn. 

7. A mobile station arranged to show function options 
as a response to control commands, characterized 
in that it is equipped (45a) to specify a certain group 
of most often used functions and to display (41) 
these functions in a certain menu of the most used 
functions as a response to a certain first control 
command. 

8. A mobile station according to Claim 7. character- 
ized in that it is also equipped to perceive that cer- 
tain functions are repeatedly used \n connection 
with one another, and to form linked groups of these 
functions (45c), whereby as a response to the user's 
selection and execution of a function belonging to 
a linked function group, the mobile station offers the 
user another function belonging to the same linked 
function group. 

9. A mobile station according to Claim 7. character- 
ized in that in the case of mutually exclusive func- 
tions (45c). It shows in said menu of the most used 
functions only the functions that can be performed 
in the state of operation at the moment. 



3. A method according to Claim 2. characterized in 
that said options intended to be the most easily se- 
lected are determined as a response to commands 40 
given by the user for selecting certain options (21 , 
22). 

4. A method according to Claim 2, characterized in 
that said options intended to be the most easily se- ^ 
lected are determined on the basis of how often the 
user selects each option (11). 

5. A method according to Claim 3 or 4, characterized 

in that while the options intended to be the most so 
easily selected comprise at least two mutually ex- 
clusive options, said menu shows only those of the 
mutually exclusive options which are possible to 
perform in the state of operation of the device at the 
moment. ss 



6. A method according to any one of the Claims 2 to 
5. characterized in that as a response to a com- 
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